Associate Data Engineer Cloud Dev Ops

Company: Blue Health Intelligence

Location: Deerfield, IL

Posted on: March 29

About BHI:

BHI is a pioneering healthcare analytics company at the forefront of AI innovation in healthcare. We are the analytics partner for Blue Cross Blue Shield plans nationwide, and our transformative solutions impact cost, quality, and outcomes from tens of millions of Americans. Our unparalleled data gives us the opportunity to drive insights into healthcare delivery.

Our team is comprised of passionate healthcare, analytics, and data engineering experts who have invested years solving the problem of turning healthcare data into insights that can drive value. We partner with BCBS Plans both nationally and locally to use these insights to drive solutions that create measurable value across the healthcare continuum. Working with these plans, were uniquely positioned to deploy AI solutions at a scale across the nations largest healthcare system. Join us as we help improve healthcare for all

Summary:

We are seeking a highly experienced Clouds Engineer with a deep understanding of AWS CI/CD processes and proficiency with CloudFormation and Jenkins. Expertise utilizing Python, Databricks, AWS Glue/EMR and cloud databases is required. Healthcare industry experience is a significant advantage. The ideal candidate will be responsible for supporting workflow management with Airflow and the CI/CD process for our AWS environment while ensuring the highest levels of performance, security, and data quality.

Responsibilities:

• Leverage AWS cloud services for data storage, processing, and analytics, optimizing cost and performance with CloudFormation and Jenkins.
• Utilize tools like Airflow for workflow management and Kubernetes for container orchestration to ensure seamless deployment, scaling, and management of data processing applications.
• Design, develop, and maintain scalable, reliable, and secure data pipelines to process large volumes of structured and unstructured healthcare data using Python and Snowflake.
• Continuously evaluate and adopt new tools, technologies, and frameworks to improve the data infrastructure and drive innovation.
• Collaborate with data architects, data scientists, and analysts to understand data requirements and implement solutions that meet business and technical objectives.
• Develop and implement data ingestion, transformation, and validation processes to ensure data quality, consistency, and reliability across various healthcare datasets.
• Monitor and troubleshoot data pipelines, proactively identifying and resolving issues to minimize downtime and ensure optimal performance.
• Establish and enforce CI/CD, infrastructure, and data pipeline operations to ensure compliance with data privacy and security regulations specific to the healthcare industry.
• Mentor and guide junior data engineers, fostering a culture of collaboration, learning, and growth within the team.
• Collaborate with cross-functional teams to align data engineering efforts with broader organizational goals and strategies.
• Is familiar with SOC 2 compliance and its impact on company policies and processes.
• Understands importance of adhering to SOC 2 requirements and maintains an effort to do so.
• Reviews and understands the Employee Handbook, and internal policies that define individual security responsibilities, and maintains segregation of duties in accordance to their role requirements

Requirements:

• Bachelor's or masters degree in computer science, Engineering, or a related field.
• 5+ years of experience in data engineering, with a strong background in Apache Spark and cloud-based databases such as Snowflake.
• Strong Knowledge in Big Data Technologies, PySpark, thorough in one or more programming language like Python
• Proven experience with AWS cloud services for data storage, processing, and analytics.
• Expertise in workflow management tools like Airflow and container orchestration systems such as Kubernetes.
• Strong knowledge of SQL and NoSQL databases, as well as data modeling and schema design principles.
• Familiarity with healthcare data standards, terminologies, and regulations, such as HIPAA and GDPR, is highly desirable.
• Excellent problem-solving, communication, and collaboration skills, with the ability to work effectively in cross-functional teams.
• Demonstrated ability to manage multiple projects, prioritize tasks, and meet deadlines in a fast-paced environment.
• A strong desire to learn, adapt, and contribute to a rapidly evolving data landscape.

The actual salary an employee can expect to receive, plus bonus pursuant to the terms of any bonus plan if applicable, will depend on experience, seniority, geographic location, and other factors permitted by law. To review benefits, please visit https://bluehealthintelligence.com/about-bhi/careers/

Base salary range: 100k 135k base

Equal Employment Opportunity It is the policy of BHI to provide equal employment opportunity and advancement opportunities to all colleagues and qualified applicants for employment without regard to race, color, religion, national origin, sex, age, disability, sexual orientation, gender identity, or any other classification protected by the federal, state, or local